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ABSTRACT 

Jln  this  paper,  we  study  the  random  generation  of  a  linear  program  of 
the  type 


P  2  Max  CX  ^  • 

subject  to  Ax  ;<  b  . 

P  is  randomly  generated  through  the  A^'s  »  ^±3  an<*  cjfs  •  We 

assume  these  random  variables  to  be  independent  and  symmetric  around 
zero  and  to  have  continuous  distribution  functions,  therefore,  trans¬ 
forming  the  random  generation  problem  into  a  distribution  free  com¬ 
binatorial  problem. 

Making  use  of  the  theory  of  d-Arrangeaents ,  we  compute  the  probabili¬ 
ties  of  P  being  feasible  and  bounded,  and  ve  also  calculate  the 
expected  number  of  faces,  of  all  possible  diaentlons,  of  the  poly tope 
that  is  the  feasibility  set  of  P  ,  given  that  P  is  feasible. 


INTRODUCTION 


The  riddle  of  the  gap  between  the  time-proven  actual  efficiency 
of  the  Simplex  method  for  linear  programs  and  its  apparent  theoretical 
inefficiency  attracted  a  great  deal  of  research  in  recent  years.  One 
of  the  more  popular  approaches  is  to  consider  the  "average"  efficiency 
of  the  Simplex  method.  The  idea  is  to  show  that  even  though  in  rare 
problems  (usually,  specifically  and  cleverly  designed  to  be  a  bad  prob¬ 
lem)  the  Simplex  method  can  take  an  exponential  number  of  iterations,  as 
a  function  of  its  size,  it  would  usually  take  modest  number  of  steps  for 
almost  all  randomly  generated  linear  programs. 

In  order  to  discuss  and  investigate  intelligently  the  average 
efficiency  of  the  Simplex  method,  one  has,  of  course,  first  to  develop 
schemes  for  random  generation  of  linear  programs.  Thus,  several  papers 
were  devoted  to  this  subject. 

Obviously,  before  studying  the  difficult  problem  of  explaining 
the  actual  behavior  of  the  Simplex  method,  some  studies  were  devoted  to 
the  study  of  simple  problems  concerning  randomly  generated  linear  pro¬ 
grams  such  as  the  expected  number  of  extreme  points,  the  probability  of 
having  unfeasible  or  unbounded  linear  programs,  etc. 

As  it  turns  out,  there  are  several  "reasonable"  methods  of  gener¬ 
ating  linear  programs  which  unfortunately  may  give  different  results. 
This  disturbing  fact  was  our  main  indication  in  initiating  the  current 
research.  We  tried  somehow  to  obtain  the  most  natural  and  robust  way 
of  generating  linear  programs. 

Thus,  in  this  paper,  we  present  a  method  of  randomly  generating 
linear  programs  which  is  based  on  randomly  generating  coefficients  of 


Che  problem  (objective  function,  matrix  of  coefficients  and  right-hand 
side).  We  preferred  that  method  over  geometrically  oriented  methods, 
because  this  is  the  way  linear  program  are  usually  perceived  by  users. 
Based  on  some  mild  assumptions  (Independence  of  all  random  variables, 
symmetry  around  zero  and  continuity  of  the  density  function) ,  we  obtain 
(In  Section  2)  several  results  concerning  the  expected  number  of  vertices 
and  the  probabilities  of  feasibility  or  unboundedness  for  any  size  of 
linear  program.  We  also  extended  some  of  the  results  to  limiting  cases 
Ce.g.,  where  the  number  of  constraints  or  variables  approaches  infinity). 
The  main  feature  (we  believe)  of  our  results  Is  that  under  the  general 
assumptions  mentioned  above,  the  results  are  Independent  of  the  actual 
distribution  function  of  the  randomly  generated  coefficients.  This 
feature  Is  the  outcome  of  viewing  the  problem  through  an  application  of 
the  theory  of  arrangements  hyperplanes  In  a  d-dimensional  space.  This 
transformation  (presented  in  Section  1)  allows  us  to  consider  the 
several  questions  Involving  expected  values  and  probabilities  as  simple 
counting  problems,  which  are  Independent  of  the  actual  distribution  of 
the  coefficients.  We  should  also  note  (as  discussed  In  Section  3)  that 
our  results  apply  to  any  form  of  linear  programs. 


NOTATION  AMP  DEFINITIONS 


Most  of  the  notation  and  definitions  in  this  paper  are  derived 
free  Grtlnbaum  [5] . 

We  denote  the  Euclidean  space  of  dimension  d  by  . 

Ve  call  a  polyhedral  set  the  Intersection  of  a  finite  number  of 
half  spaces.  A  nonempty  polyhedral  set  is  called  a  polyhedron  and  a 
poly tope  is  a  bounded  polyhedron.  If  a  polyhedron  (polytope)  is  of 
dimension  d  ,  ve  call  it  a  d- polyhedron  (d-polytope) .  Consider  a 
d- polyhedron  F  ;  a  k-dimensional  face  of  F  is  referred  to  as  a 
k-face;  P^(F)  ,  0  <  k  <  d  ,  denote  the  set  of  all  k-faces  of  F  , 
a  member  of  F^(F)  is  called  a  vertex,  an  edge  or  a  facet  of  F  if 
k  •  0  ,  k  ■  1  or  k  ■  d  -  1  . 

Given  an  n  *  d  matrix  A  and  sequences  I  C  { 1 ,  . . . ,  n)  and 

JC(1 . d)  ,  ve  denote  by  A^  the  submatrix  of  A  associated 

vlth  the  rovs  in  I  ;  by  A  .  the  submatrix  of  A  associated  vlth 

the  columns  in  J  .  Me  denote  by  A^  the  iC^  row  of  A  and  by 

A  .  the  column  of  A  . 

•  j 

Consider  the  linear  program: 

P  :  Max  cx 
subject  to  xgX 

vhere  X  is  the  polyhedral  set  (x€E^|Ax<.b>.  X  is  called 
the  feasibility  set  or  constraint  set  of  P  .  The  hyperplanes 
(x  |  k±  •  bj}  ,  for  all  rovs  of  A  are  called  the  supporting  hyper¬ 
planes  of  the  half  spaces  of  X  . 
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Finally,  the  symbol  O  will  be  placed  at  the  end  of  a  proof, 
and  the  symbol  I  will  be  placed  at  the  end  of  a  theorem  or  lemma, 
which  will  be  presented  without  proof. 


1.  THE  RANDOM  GENERATION  OF  LINEAR  PROGRAMS 
1,0  Introduction 

In  this  section,  we  define  a  random  linear  program  and  introduce 
the  process  of  generating  such  a  program. 

We  define  a  random  linear  program  as  a  linear  program  for  which 
ve  have  a  random  objective  function  and  a  random  constraint  set.  More 
specifically:  we  consider  random  programs  of  the  type: 

P  :  Max  cx 
subject  to  Ax  <_  b 

where  A  ,  c  ,  b  are  randomly  generated  so  that  P  is  generated 
through  the  random  variables  A^'s  »  ^±%s  “d  Cj?S  * 

We  assume  the  A^’s  *  b^'s  and  cj,s  t0  be  independent 
random  variables  and  symmetric  around  zero  and  to  have  continuous 
distribution  functions.  These  assumptions  are  crucial  for  obtaining 
the  main  results  of  the  paper. 

In  the  following,  we  shall  present  the  process  of  randomly 
generating  linear  programs  and  present  some  theorems  which  are  applied 
in  the  development  of  our  results. 

1.1  Random  Half  Spaces 

Consider  the  following  linear  program,  to  be  randomly  generated: 

P  :  Max  cx 
sub j  ect  to  Ax  b  , 


where  A  is  n  *  d  ,  b  is  n  *  1  ,  and  c  is  d  *  1  ,  n  *  d  . 


(For  the  application  of  our  results  to  linear  programs  in  other 


forms ,  see  the  remarks  in  Section  3*) 

The  following  assumptions  are  crucial  for  the  results  obtained 
in  the  next  chapters  and  will  be  often  referred  to  as  the  assumptions 
of  Section  1.  We  will  now  formalize  them. 

Assumption  1: 

All  the  A^’s  •  b^'s  and  c^’s  of  P  are  independent  random 
variables . 

Assumption  2: 

The  random  variables  A^’s  ,  b^'s  and  's  have  continuous 
distribution  functions. 

Assumption  3: 

The  random  variables  t  b^*s  and  are  symmetric  around 

zero. 

We  can  now  state  the  following  theorem  about  the  random  half  spaces 
of  P  which  is  the  basis  for  the  results  about  the  constraint  sets  of 
random  linear  programs  in  Section  2. 
let  a  S  and  a  G  IE*  ;  denote 

H(a)  *  {x  |  x  •  aa  for  any  a  +  0} 

H* (a)  *  {x  |  x  •  aa  for  any  a  >  0} 

H  (a)  »  (x  |  x  *  aa  for  any  a  <  0}  . 
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Theorem  1.1.1 

Let  A.  ,  b.  be  realized  values  for  Che  random  variables 
1*  1 

A  ,  b .  (for  some  1  <_  i  <_  n) . 

Suppose  assumptions  1-3  above  are  satisfied,  then  if  A^  ,  b^  are 
randomly  generated  such  that  (A^,bj)  €  H(A^,bj)  ,  then 

Prob  [(A±> ,b±)  eH^CA^.bJ  -  Prob  [(A^.b^  eH'U^.b^J  -  1/2  .  I 

Note  that  since  jx  6  Ed  [  A^x  <_  b^  -  jx  €  Ed  |  -A^x  >_  -bjJ  it 
follows  from  Theorem  1.1,1  that  if  ^x  €  Ed  |  A^  x  ■  b^|  is  a  supporting 
hyperplane  of  the  randomly  generated  constraint,  then  it  is  equally 
likely  that  the  iC^  constraint  is  either  |  x  6  Ed  |  A^  x  <_  b  ^  |  or 

j,eid|  V'ibJ. 

The  proof  of  Theorems  1.1.1  and  1.2.1  follows  directly  from  the 
assumptions  above,  standard  manipulations  and  the  use  of  the  theory  of 
transformation  of  random  vectors,  that  can  be  found  in  Bickel  and 
Doksum  [2];  the  details  of  these  proofs  can  be  found  in  Berenguer  [1]. 

1.2  The  Objective  Function 

We  generate  the  objective  function  cx  by  randomly  generating  the 
vector  c  *  (c^,  c^)  . 

Obviously,  for  every  objective  function  cx  ,  there  corresponds  a 
set  j(kc^,  •••>  kc^)  €  |  k  >  o|  which  represent  the  same  objective 

function.  Thus,  we  shall  refer  to  a  given  objective  function  as  a  family 
of  hyperplanes  in  which  any  member  of  this  family  represents  the  same 
objective  function. 


ws 
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Theorem  1.2.1 


Let  c  be  a  realizable  objective  function  vector  for  P  ,  then  if 
c  is  a  randomly  generated  objective  function  for  P  ,  such  that 
c  €  H*(c)  ,  then 


Prob  [c  €  H"(c)]  -  Prob  [c  €  H  (c) ]  -  1/2  . 


Note  that  since  max  cx  is  equivalent  to  -min  (-cx)  ,  Theorem  1.1.2 
implies  that  given  cx  as  the  objective  hyperplane  it  is  equally 
likely  that  the  objective  is  either  maximizing  or  minimizing. 
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2.  d-ARRANGEMENTS  AND  THE  RANDOM  GENERATION  OF  LINEAR  PROGRAMS 
2 « 0  Introduction 

Using  the  assumptions  of  Section  1  and  the  theory  of  d-Arrangements , 
we  will  transform  our  linear  program  random  generation  problem  into  a 
combinatorial  problem. 

In  this  section  we  will  compute  the  expected  value  for  the  number  of 
faces  of  every  possible  dimension  of  the  random  linear  program.  Prob¬ 
abilities  of  being  feasible  and  of  being  bounded  for  the  random  linear 
program  will  also  be  calculated. 

2 . 1  d- Arrangement  s 
Definition: 

A  finite  family  A  of  n  >  d  hyperplanes  forms  a  d-Arrangement  of 
hyperplanes  in  ,  provided  that  no  point  in  lE^  belongs  to  all 

elements  of  A  .  The  n  hyperplanes  partition  IE**  into  a  finite 

number  of  d-polyhedral  sets:  the  facets  of  these  d-polyhedral  sets  are 
formed  by  those  hyperplanes  and  no  point  in  the  interior  of  any  of  the 
d-polyhedral  sets  belongs  to  any  of  the  hyperplanes.  These  polyhedral 
sets  are  also  called  the  d-faces  of  the  d-Arrangement.  The  k-faces  of 
the  d-Arrangement,  for  0  <  k  <  d  ,  are  the  k-faces  of  the  d-faces  of  the 
d-Arrangement. 

Definition: 

A  set  of  n  hyperplanes  have  the  general  intersection  property 
if  the  intersection  of  every  set  of  K  of  those  hyperplanes  is 
a  (d  -  k)  -dimensional  linear  affine  space  (if  d-k  is  negative,  then  the 
Intersection  is  considered  void) . 
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Let  F^(k,n)  be  the  total  number  of  k-faces  of  all  d-polytopes 
of  the  d- Arrangement  formed  by  a  family  of  n  hyperplanes.  Also, 
define  F0(0,n)  -  1  . 

We  can  now  state  the  following  lemmas,  due  to  Buck  [3]. 

Lemma  2.1.1: 

The  number  of  k-faces  of  a  d-Arrangement  formed  by  a  family  A 
of  n  hyperplanes,  having  the  general  intersection  property  in  1E^  , 
is  given  by 


Fd0t,n)  «  [d-k]Fk(,t,n  +  k"<i) 


Corollary: 

The  number  of  d-polyhedral  sets  in  A  is  given  by 


Lemma  2.1.2: 

The  number  of  bounded  k-faces  of  A  ,  given  the  general  intersec¬ 
tion  property  is: 


d  +  1 
n  +  k  -  d 


Corollary: 

The  number  of  d-polytopes  of  A  is  given  by 

*>•■»  •  [V]  • 


2.2  d-Arrangements  and  the  Constraint  Set  of  a  Randomly  Generated 
Linear  Program 


We  will  now  relate  the  results  of  Section  2.1  about  d-Arrangements 
to  the  constraint  sets  of  random  linear  programs  by  making  use  of  the 
results  obtained  in  Section  1.  Recall  that  we  assume  the  random  linear 
program  P  to  have  the  following  representation: 

P  :  Max  cx 

subject  to  x  G  X  =  {x  |  Ax  <  b}  , 

where  A  is  n  *  d  ,  b  is  n  *  1  ,  c  is  d  *  1  ,  for  2  <_  d  <_  n  and 
n  <  d  . 


Theorem  2.2.1: 

Given  the  assumptions  of  Section  1,  the  supporting  hyperplanes  of 
the  half  spaces  of  X  ,  {x  )  A^#  ■  b^}  ,  i  *  1,  . . . ,  n  ,  have  the  general 
intersection  property  with  probability  one. 


Proof : 


Berenguer  in  [1]  shows  that  the  hyperplane  *  {x  |  A^#x  *  b^} 

can  be  fully  characterized  by  x^  =  •**>  xdYi)  *  t*ie  P°^nt  w^ere 

the  line  perpendicular  to  and  passing  through  the  origin  meets  the 

hyperplane;  so,  can  be  determined  by  x^  and  the  density 

f  (x1u,  ...,  xJU)  characterizes  the  random  hyperplane.  It  is  also  shown 
H  1H  on 


that,  given  the  assumptions  of  Section  1,  x  has  a  continuous  dis- 

in 

tribution  function. 

We  can  show  that  the  probability  of  any  two  hyperplanes,  say 

1  2 

and  ,  characterized  by  the  points  x^  and  x^  with  densities 
f^  and  f2  being  parallel  to  each  other  is  equal  to  zero.  Let 
PfH^  B  H^]  be  this  probability.  Then: 
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P£H2  B  Hx]  -  J  •••  j  f1(xJH,  •••*  xJH)P[H2  1  H1  I  HlldXlH’  dxdH  * 

«ao  — ao 


But 


P[H2  II  Hx  I  HJ 


where  is  the  line  that  passes  through  the  origin  and  x^ 

characterizes  all  the  hyperplanes  that  are  parallel  to  . 

Since  has  d-dimensional  Lebesgue  measure  (see  Halmos 

2 

Chapter  VII)  equal  to  zero  (d  >_  2)  ,  and  by  Assumption  2, 
continuous  distribution  function,  we  have  It  |  H^]  =0  . 


and 

[6], 

has 

Hence 


p[h2  l  H2  I  hx1  =  o  . 


Also,  since  no  two  hyperplanes  are  parallel,  we  have  that  k 
hyperplanes,  2  <_  k  <_  d  ,  will  necessarily  meet  in  some  (d  -  k) -dimensional 
plane  in  1E^  .  Clearly,  those  (d  -  k) -dimensional  planes  have 
d-dimensional  Lebesgue  measure  zero  in  1E^  and  because  of  the  con¬ 
tinuity  of  the  distribution  functions  of  the  x^’s  ,  we  can  easily  show, 
in  a  similar  way  of  the  nonparallelism  proof  above,  that  no  other  hyper¬ 
plane  will  meet  those  k  hyperplanes  in  the  same  (d  -  k) -dimensional 
plane.  I 


Corollary  1: 

The  supporting  hyperplanes  of  the  half  spaces  of  X  -  {x  |  A^-x  *  b^}  , 
i  *  1,  n  form  a  d-Arrangement . 
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Proof ; 

According  to  Theorem  2.2.1,  those  supporting  hyperplanes  have  the 
general  intersection  property,  and  therefore,  no  point  belongs  to  all 
n  >  d  hyperplanes  since  that  would  contradict  the  fact  that  d  +  1 
hyper planes  do  not  Intersect  at  the  same  point.  □ 


Corollat 


The  supporting  hyperplanes  {x  |  A^x  »  b^} 

half  spaces  of  X  partition  TE^  into  F^(d,n) 
d-poly topes. 


,  i  *  1 ,  . . . ,  n  of  the 

•jo H  dl£fe”"t 


Proof: 

Directly  follows  from  the  corollary  of  Lemma  2.1.1,  Theorem  2.2.1 
and  Corollary  1  above.  □ 


Note  that  Theorem  2.2.1  allows  us  to  apply  combinatorial  results  of 
d-Arrangements  in  calculating  probabilities  relating  to  randomly  generated 
linear  programs.  Note  that  a  randomly  generated  polyhedron  might  be  of 
dimension  less  than  d  .  However,  the  assumptions  of  Section  1  guarantees 
that  the  randomly  generated  polyhedron  (if  nonempty)  will  be  of  dimension  d 
with  probability  one. 

Theorem  2.2.2: 

Let  the  assumptions  of  Section  1  be  satisfied  for  the  random  genera¬ 
tion  of  P  .  Let  A  and  b  be  possible  values  that  can  occur  for  the 
random  matrix  A  and  the  random  vector  b  .  So,  given  that  {A^#x  *  b^}  , 
i  ■  1,  ...,  n  occur  as  supporting  hyperplanes  of  the  half  spaces  of  X  , 
forming  a  d-Arrangement  in  ,  then  all  the  different 


d-polytopes  that  are  the  d-faces  of  that  d -Arrangement  have  equal 
probability  of  occurring  as  the  constraint  set  of  the  random  linear 
program  P  ,  namely  l/2n  . 


Proof : 

Given  that  the  hyperplanes  {x  |  Ai#x  *  b^}  ,  i  »  1,  . ..,  n  ,  occur, 
it  follows  from  Theorem  2.2.1  that,  with  probability  one,  they  have  the 
general  intersection  property  and  form  a  d-Arrangement .  Then,  each  of 
the  d-polytopes  of  this  d-Arrangement  corresponds  to  a  unique  combina¬ 
tion  of  inequality  signs,  ^  or  _<  ,  for  the  half  spaces  of  the 
constraint  set  of  P  .  Since  we  have  n  hyperplanes,  we  have  2n 
possible  combinations  for  the  inequality  signs,  or  .  We  will  now 
show  that  each  combination  has  probability  1/ 2n  of  occurring.  By 
Theorem  1.1.1  we  have  that,  given  the  hyperplane  {x  |  A^x  •  b^}  , 

1  i  n  ,  each  of  the  inequality  signs  and  occur  with  prob¬ 
ability  1/2  ,  i.e.  ,  the  half  spaces  {x  j  A^x  £  b^}  and  {x  |  A^x  b^} 
occur  with  probability  1/2  .  So,  given  the  hyperplanes,  all  the  in¬ 
equality  signs  occur  with  equal  probability  and  each  combination  of  them 
has  equal  probability  1/ 2n  of  corresponding  to  the  constraint  set  of 
P  . 

Corollary  1: 

Given  the  assumptions  of  Section  1,  the  probability  of  the  random 
linear  program  P  having  a  feasible  constraint  set  is  equal  to 
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Proof: 

The  n  hyperplanes  {x  |  A1#x  -  b^}  of  P  will,  with  probability 
one,  fora  a  d-Arrangeaent  In  Ed  ,  with  ?d (d,n)  d -poly topes,  that 
will  correspond  to  possible  feasible  constraint  sets  for  P  .  It 
easily  follows  froa  Theorea  2.2.2,  that  the  probability  of  a  feasible 
constraint  set  Is  equal  to 


Pp(n,d) 


Proposition  2.2.1: 


11a  Pp  ■  0  and 


d  constant 


11a  P_(n,d)  -  1 
n,d-*«» 

n-d«a  constant 


□ 


I 


Corollary  2: 

Given  the  assuaptlona  of  Chapter  1,  the  probability  of  the  randoa 
linear  prograa  P  having  a  feasible  bounded  constraint  set  is  equal  to 


Pp(n,d) 


I 


For  the  randoa  linear  prograa  P  ,  we  had  shown  that,  with  probability 
one,  the  supporting  hyperplanes  of  the  half  spaces  of  X  will  fora  a 
d-Arrangeaent,  Independent  of  the  distributions  of  A  ,  b  and  c  ,  as  long 
as  the  assuaptlons  of  Section  1  are  satisfied.  We  also  calculated  the 
probabilities  for  feasible  and  bounded  constraint  sets.  For  this  we  used 
the  alaost  sure  d-Arrangeaent  structure  of  the  hyperplanes  that  allowed 
us  to  apply  coablnatorlal  type  arguaents  to  the  problea. 


I 


\ 


,  1 
t  1 


4 


J 


16 


Now,  we  will  continue  our  study  to  obtain  the  main  result  of  this 
section  which  is  the  computation  of  expected  values  for  the  number  of 
faces  of  the  d-polyhedron  that  constitutes  the  constraint  set  of  the 
random  linear  program.  The  next  lemmas  are  the  first  steps  towards  this 
objective.  Before  that  we  need  one  more  definition: 

Definition: 

n  hyperplanes  in  ,  n  >  d  ,  are  said  to  have  the  general  position 

property  if  the  normal  vectors  of  the  elements  of  every  d-subset  of  the 
n  hyperplanes  are  linearly  independent.  We  also  say  that  the  n  hyper¬ 
plane  8  are  in  general  position  or  that  the  normal  vectors  are  in  general 
position . 

Lemma  2.2.1: 

Let  n  (n  >  d)  hyperplanes  in  have  the  general  Intersection 

property.  Then  they  also  have  the  general  position  property.  I 

The  proof  of  2.2.1  is  easily  obtained  from  the  definitions  of 
these  two  properties. 

The  next  lemma  is  due  to  Schttfli  in  [8]. 


Lemma  2.2.2: 

n  hyperplanes  in  ,  n  d  ,  all  passing  through  a  given  point 

x°  and  having  the  general  position  property  partition  Ed  into 

d*l  2*1  q 

2  \  ’  cones  with  x°  as  an  apex,  such  that  no  point  In  the 

i-0  L  1  J 

interior  of  any  of  the  cones  belongs  to  any  of  the  hyperplanes.  I 

Corollary: 

d  hyperplanes  having  the  general  intersection  property  partition 
into  2^  cones. 
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Proof ; 

From  Loom*  2.2.1,  we  know  that  d  hyperplanes  In  E**  having 
tha  ganaral  Intersection  property,  also  have  the  general  position  property. 
Hence,  they  all  meet  In  a  given  point  and  as  a  straightforward  applica¬ 
tion  of  Lemma  2.2.2,  It  follows  that  those  d  hyperplanes  partition 
E*  Into 


2 


cones. 


□ 


Lemma  2.2.3: 

■  ■  m  ■ 

For  a  d-Arrangement  formed  by  n  hyperplanes,  having  the  general 
Intersection  property  In  E^  ,  a  k-face  is  contained  In  exactly  2^'^ 
d-  faces,  for  0  <_  k  d  . 

Proof : 

We  will  consider  3  possible  cases: 

(1)  k  »  0  ;  since  the  hyperplanes  have  the  general  intersection 

property,  we  know  that  every  d-set  of  them  must  Intersect 

in  a  0-face.  By  the  corollary  of  Lemma  2.2.2,  we  know 

that  these  d  hyperplanes  form  2**  cones  with  that 

0-faces  as  apex.  It  easily  follows  that  every  0-face  is 

contained  in  exactly  2^  d-faces. 

(11)  0  <  k  <  d  ;  the  proof  Is  based  on  a  proof  of  a  similar 

theorem  found  In  Cover  and  Efron  [4];  consider  a  0-face 

Q  of  the  d-Arrangement  and  let  H^,  . ...  Hj  be  the  d 

different  hyperplanes  that  Intersect  at  Q  and  a,,  ....  a. 

i  c 

normal  vectors  of  H^,  ....  .  We  will  prove  that  every 
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d*lc 

k-face  containing  Q  is  itself  contained  in  2  of 
the  2^  different  cones  with  apex  Q  and  formed  by  the 
hyperplanes  H^,  ...»  Rj  . 

Without  loss  of  generality,  choose  any  d-k  hyperplanes  of 

d-k 

H-  ,  . . . ,  H .  ,  say  H, ,  . . . ,  H ,  ,  and  let  H  -  O  H.  be  the  k- 
id  1  d-k  ±ml  i 

dimensional  linear  subspace  orthogonal  to  the  vectors  a^,  a^_^  • 

The  remaining  k  hyperplanes  •  ••,  partition  H  into 

I  P*  4  ^1  ■  *  convex  cones  C  ,  1*1,  . ..,  2k  1  (this  can  be 

i*0  L  1  J  % 

verified  by  noting  that  the  projections  of  ad  into  H 

are  in  general  position  in  that  subspace  and  that  the  intersection  of 
with  H  ,  for  i-d-k  +  1,  ...,d  is  the  (k  - 1) -dimensional  subspace 
of  H  that  is  orthogonal  to  the  projection  of  a^) .  The  interior  of  each 
of  the  cones  C ^  can  be  characterized  as  the  set  of  solution  vectors  w 
to  the  simultaneous  relations 

* 

sgn(ajW)  -  5±  i  -  1,  ...,  d 
where  5^  *  0  for  i  *  1,  . ..,  d-k 

and  6^  *  +1  for  i  ■  d-k  +  1,  . d  . 

Where  sgn  is  the  sign  function  defined  on  1R  : 

sgn(y)  -  1  ,  y  >  0 

sgn(y)  -  0  ,  y  •  0 

sgn(y)  ■  -1  ,  y  <  0  . 

* 

Let  <5  -  (6- ,  6.)  be  a  vector  of  +l*s  such  that  5.  ■  6 .  for 

id  —  11 

i  >  d-k  +  l  .  It  follows  by  continuity  that  every  6  represents  a 
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nonempty  solution  cone  having  as  a  k-boundary  and  that  those  2d  k 

solution  cones  are  the  only  ones  having  this  property.  It  follows  that 
every  k-face  is  contained  in  one  of  those  k-boundaries.  Since  each 
d-face  to  which  Q  belongs  can  be  associated  to  one  of  those  2**  cones 
and  none  of  the  k-faces  that  contains  Q  can  be  contained  in  any  other 
d-face  than  those  2d  ones  (this  could  imply  that  Q  would  belong  to 
more  than  2d  d-faces),  then  the  proof  is  complete. 

(iii)  k  -  d  ;  the  result  is  obvious,  for  this  case.  □ 


We  can  now  state  and  prove  the  main  theorem  for  this  section: 


Theorem  2.2.3: 

Under  the  assumptions  of  Section  1»  the  expected  number  of  k-faces, 
0  £  k  <_  d  ,  of  the  d-polytope  that  is  the  constraint  set  of  the  random 
linear  program,  assuming  feasibility,  is  given  by: 


ed(k,n)  -  2d~k 


Fd(k,n) 

FjTd^n) 


k  -  0, 


d  . 


Proof: 

From  Theorem  2.2.1  ve  know  that  the  n  supporting  hyperplanes  of 
the  constraint  set  of  P  have  the  general  intersection  property  and, 
with  probability  one,  will  form  a  d-Arrangement  in  .  By  Theorem 

2.2.2,  it  follows  that  all  the  Fd(d,n)  different  d-poly topes  of  the 
d-Arrangement  have  equal  probability  of  occurring  as  the  constraint  set 
of  P  .  Therefore,  the  expected  number  of  k-face  is  equal  to  the  total 
number  of  k-faces,  for  all  the  Fd(d,n)  d-polytopes,  divided  by  the  number 
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of  d-poly topes  in  the  d-Arrangement.  It  is  left  to  show  that  2^  ^^(Ic.n) 
is  the  total  number  of  faces  for  all  the  d-poly tope;  this  result  easily 
follows  if  we  recall  that  we  have  F^(lc,n)  k-faces  in  the  d-Arrangement 
and  that,  according  to  Lemma  2.2.3,  each  of  those  k-faces  belongs  to 
2  of  the  d-polytopes*  □ 


It  should  be  acted  that  the  expected  numbers  of  k-faces 9  for 
0  <_  k  <_  d  ,  do  not  necessarily  combine  to  form  a  d-polytope,  since  it  is 
easy  to  show  that  the  e<j(k,n),s  do  not  necessarily  satisfy  Euler's 
relation  for  the  number  of  faces  of  a  d-polytope  and  clearly  are  not 
necessarily  integers* 

We  will  now  present  some  limiting  properties  of  e^(k,n)  • 


Corollary  1: 


For  a  given  d  ,  and  given  that 


is  feasible,  ve  have 


(i)  lim  e^(k,n)  •  ®  —  k  d  .  That  is,  when  n 

goes  to  •  and  d  remains  constant  the  expected  number 
of  all  dimensional  faces  of  constraint  set  of  P  is 
the  same  as  that  of  a  d -hyper cube. 


(ii) 


(the  number  of  k  faces  of  the  d-hypercube)  is 


an  upper  bound  for  e^(k,n)  ,  for  0  £k  <_d  ,  for  every  n  . 

It  is  also  clear  that  lim  e^(k,n)  -  2*  kpH  from  below. 

n-*°°  ■* 
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(ii)  We  have  to  show  that,  for  every  n  ,  e^(k,n)  <_  2 
0  <  k  <  d  .  This  is  obviously  true  for  k  *  d  . 
We  know  that 


d-kfd 
k  ’ 


ed(k,n) 


£  [I] 

i*0  L  -> 


2^  ^  j  n  u  L(k,n-d  +  k) 

_ L £-ZJ£J _ _ _ 

L(d,n) 


where  L(d,n)  =  \  °  •  We  can  Chen  write 

i=0  L1-1 


ed(k,n) 


-  2  (d -k)!(n-d+k)>  L(k,n~d+k) 

L(d,n) 

0d-k  d?  k!  n?  T  n  ,  ,  . . 

=  2  k!  (d  -  k) !  d!  *  (n-d  +  k)!  L(k,n~d  k) 

L(d,n) 

d-kplk!  ni  L(k,n  -d  +  k) 

2  (kid!  (n-d+k)!  L(d,n) 


However, 


k! 

n! 

d! 

(n-d  +  k)  ! 

k! 

n! 

d! 

(n-d  +  k)! 

k! 

n! 

L(k,n  -  d  +  k) 
k  r  ,  .  ,  • 


k l  n!  y  (n-d  +  k)! 

d!  (n-d  +  k)!  .£Q  (n-d+k-i)!i! 


k!  r  _ nj _ 

d!  ,“0  (n-d  +  k-  i)!i! 


1  r  n! 

-i —  )  7 - r^TTi — TTTT7  *  0  <  k  <  d  -  1 

d  J|.  (n-])!(j-d  +  k)!  -  - 

IU  J_d 


£=k+l 


j=d-k 


(n  -  j) !  |(j  -  d  +  k) ! 


n£  )  i=0 

l=k+lf 


d-k-1  , 

r  n! 

An  i!  (n  -  i) ! 


V-i.  I 

+  y  — 2^— 

,A  ,  i!  (n  -  i) 


i=d-k 


■  jo  [”]  •  lW-n>  • 


Hence , 


ed(k,n)  <  2 


d-krd~lL(d,n) 


kjL(d.n) 


2dk£  ,  0  £  k  <_  d  -  1 


As  n  goes  to  00  and  d  remains  constant,  the  probability  of 
feasibility,  Pp(d,n)  goes  to  zero,  but  it  should  be  mentioned  that 

,  _  .d-kfdl  .  ....  .  .  ,  ,  s 


given  feasibility,  2  is  an  upper  bound  for  e^(k,n)  ,  for 

0  <^k  <  d  .  However,  this  is  not  a  sharp  bound,  for  0  <_  k  <_  (d  -  1) 
We  will  show  it  for  k  =  0  and  k  =  (d  -  1)  (extreme  points  and 
facets) . 


Corollary  2: 


(i)  For  k  = 


fn-  [  (d  +  1)/2]1  fn-  [(d  +  2)/2]1 

0  •  ^°’n)  -  [  .-a  M  n  -  d  J 


for  n  <  d  +  [(d  +  l)/2] 


(ii)  For  k  -  d-1  ,  e,(d-l,n)  <  min(n,2d)  . 
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Proof : 


(i)  For  a  given  m  ,  ,  where  d  >  m  is  an  increasing  function 

of  d  *  We  can  write 


2  -  i  Lil-s 

i»0  L  J 


We  know  that 

n  -  [ (d  +  2) /2]  <  n  -  [(d  +  l)/2]  <  d 
Therefore, 

n-d  <  [ (d  + 1)/2]  <  d  . 

Hence , 


n-  [(d  +  l)/2f 
n-d 


Also, 


[  d  14 d  14 d  W°’i£d+2>/::] 

Ld  -  (n  -  d)  J  L2d  “  nJ  Ln-dJ  n  -  2  J 


Since 


S  > 


L-J  "d  L.J 


a-  [(d  +  l)/2]‘ 

a-  t(d  +  2)/2]‘ 

.  n-d 

n-d 

a  -  [(d  +  l)/2]‘ 

n-[(d  +  2)/2]' 

u 

.  n-d 

n-d 

are  terms  of  S  ,  we  have 


.  But,  since 


is  the  maximal  number  of 


extreme  points  for  a  d-polyhedron,  with  n  facets 
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(McMullen  [7]),  we  then  have 


{(0,n)  < 


n-  [(d  +  l)/2f 

* 

n-  C(d  +  2)/2]l  . 

h  <  2d 

n- d 

-  n  -  d 

for  n<d  +  [(d  +  l)/2] 


(il)  It  suffices  to  show  that  for  d  >  j  ,  ed(d  -  l,n)  <  n  .  Let 


L(d,a)  -  f  [;]  -  l  [fl  -  I  [;] 

1-0  L1-1  i-0  L1J  i-d+1  L*J 


-  2“  -  L(n,d)  . 


Similarly, 


-.n-1 


L(d-l.n-l)  -  2“  -  -  L(n-l.d-l) 

_ nj _  . _ n! 


L(d,n)  - 


(d  +  1)  !  (n  -  d  -  1)  !  (d  +  2)  !  (n  -  d  -  2) ! 


+  •••  + 


a! 


(n-2)!2! 


n! 


a! 


(n  -  1)  !1!  n! 


L(d-l.n-l)  - 


{3—m 


<n-l)t 


d!  (n  -  d  -  1)  !  (d  + 1)  !  (n  -  d  -  2)  ! 


..  » 

(n  -  3) !2! 


(a  -  1) !  +  (n  -  lj.! 

(n  -  2)  !1!  (n-1)! 


Since  d  >  y  ,  2  >  j  and 


2L(d  -  l,n  -  1)  > 


n! 


a! 


d(d! )  (n  -  d  -  1) !  d(d  +  1) !  (n  -  d  -  2)  ! 


+  •< 


.  n!  nl  .  n!  . 

d(n-3)!2!  d(n-2)!l!  d(n-l)! 


Therefore, 


» - ~'%TTT~  "" 

— - W— 


25 


2L(d  -  l,n  -  1)  >  L(d,n)  or  2L(d-l,n-l)  -  L(d,n)  >  0 
and 

L(d,n)  -  2L(d  -  l,n  -  1) 

-  2°  -  L(d,n)  -  2n  +  2L(d  -  l,n  - 1)  -  2L(d-l,n-l)  -  L(d,n)  >  0  . 
Hence, 


L(d,n)  >  2L(d  -  l,n  -  1) 


and 


ed(d  -  l,n) 


2nL(d  -  l.n  -  1)  2nL(d  -l.n-1) 
L(d,n)  2L(d  -  l.n  -  1)  * 


Therefore,  for  d  >  n/2  ,  ed(d-l,n)  <  n  . 


□ 


In  a  similar  way  we  can  show 


Corollary  3; 

When  n  -►  •  and  n-d  *  m  remains  constant,  e^(k,n)  goes  to 

C*-k]  Jq 

r*+ 
i-0  L  1 

Note  that  the  limit  of  ed(d,n)  (i.e. ,  the  expected  number  of  facets), 
is  equal  to  n  .  This  should  be  expected  since  ?p(n,d)  -  1  ,  i.e., 
the  probability  of  feasibility  in  this  case  is  equal  to  one,  and  all  the 


supporting  hyperplanes  of  the  half  spaces  of  X  should,  with  probability 
one,  form  a  facet  of  the  d-polyhedron  that  Is  the  constraint  set  of  P  . 


2.3  d-Arrangements  and  the  Objective  Function  of  Randomly  Generated 
Linear  Programs 

* 

Let  the  family  of  hyperplanes  H  characterize  the  objective  function 
cx  of  P  . 

Lemma  2.3.1: 

Given  a  nonempty  cone  C  ,  with  some  point  Q  €  Ed  as  an  apex, 
and  a  hyperplane  H  passing  through  Q  ,  exactly  one  of  the  following 
two  cases  can  happen  (with  probability  1) : 

(i)  H  is  tangent  to  C 

(li)  H  partitions  C  to  two  nonempty  cones,  and  C2  , 

each  with  an  apex  Q  .  I 

Using  Lemma  2.3.1,  one  can  easily  prove 

Lemma  2.3.2: 

Given  2^  nonempty  cones  formed  by  d  hyperplanes  H^,  . . . , 
intersecting  at  a  point  Q  in  1E^  ,  having  the  general  intersection 
property  and  another  hyperplane  H  ,  passing  through  Q  ,  such  that 

H  ,  . Hj  are  in  general  position,  then  H  partitions  2^  * 

of  the  2^  nonempty  cones  to  two  cones  each  and  H  is  tangent  to 
exactly  two  of  the  2**  nonempty  cones.  I 

Theorem  2.3.1: 

Let  the  assumptions  of  Section  1  be  satisfied.  Then,  given  that 
the  random  linear  program  P  is  feasible,  we  have 
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The  probability  of  a  given  vertex  of  the  d-Arrangement 
fomed  by  the  supporting  hyperplanes  {x  |  A^x»b^}  , 

1  ■  1 . n  of  the  half  spaces  of  X  ,  being  the  optimal 

extreme  point  for  P  is  equal  to 

The  probability  of  the  random  linear  program  P  being 
bounded  is  equal  to 


Proof : 

(1)  Due  to  the  assumptions  of  Section  1,  the  supporting  hyperplanes 
of  the  half  spaces  of  the  constraint  set  of  P  ,  H^,  . ..,  Hq  , 
with  probability  one,  form  a  d-Arrangement  in  E^  ,  as  shown 
in  Theorem  2.2.1.  Let,  after  the  random  generation  A  ,  b 
and  c  be  the  values  generated  for  A  ,  b  and  c  . 

-  {x  |  AjX»b^}  1*1,  ...,  n  and  let  H  represent  the 
family  of  hyperplanes  that  characterizes  the  objective  function 
cx  .  Then,  let  Q  be  a  vertex  of  the  d-Arrangement  formed  by 
the  hyperplanes  ,  such  that,  without  loss  of  generality, 

Q  is  the  intersection  of  the  hyperplanes  . Hj  . 

A 

Consider  now  a  hyperplane  H  €  H  passing  through  Q  .  Due 
to  the  assumptions  of  Chapter  1,  we  have  that  the  hyperplanes 
H  ,  ....  are  in  general  position  with  probability  one. 

From  Lemma  2.3.2  we  know  that  H  Is  tangent  to  two  of  the 
d-polyhedra  to  which  Q  belongs.  So,  there  exists  exactly 
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1  2 

two  polyhedra  say  X  ,  X  la  tb«  d-Arrangement  for 
which  H  Is  tangent  to  them  at  Q  .  Moreover,  it  Is  obvious 
that  Q  maximizes  the  objective  function  represented  by  H 
over  one  polyhedron  (say  X®)  and  minimizing  it  over  the  other 
(••y  X2).  Since  (by  Theorem  1.2.1)  there  is  equal  probability 
that  the  objective  is  maximize  or  minimize  and  since  X2  and 
X  can  be  selected  with  a  probability  of  1/F^(n,d)  we  get 
that  Q  has  probability  of  j  •  g  ^  of  being  the  optimal 

extreme  point  of  X2  and  similarly  for  X2  .  Thus  Q  has  a 
probability  of  2  •  ^  ..  •  _  ..  of  being  the  optimal 

extreme  point  of  the  randomly  generated  P  . 

(li)  As  it  follows  that  for  any  H  €  H  ,  H  ,  H, ,  ...,  H  are  in 

l  n 

general  position,  then  P  Is  bounded  if  and  only  if  an  extreme 
point  is  the  unique  optimal  solution.  Since  we  have 

ro¬ 


of  being  the  optimal  extreme 


F^(Otn)  -  vertices  in  the  d-Arrangement  and  each  of  them 

has  equal  probability  ^ 


i  I ; 

i-0  L  ■ 

point,  it  follows  that  the  desired  probability  is 


□ 


'  i 

„  t 

4 

.a 


Corollary; 

The  probability  of  the  random  linear  program  P  being  bounded  (and 
feasible) ,  not  conditioning  on  feasibility,  is  equal  to 


Since  PR(n,d)  is  the  desired  probability  when  we  condition  on 
feasibility  and  the  probability  of  feasibility  is  equal  to  Pp(n,d) 


(i)  lim  PB(n,d)  =  1  and 

n-*o° 

(ii)  lim  Pfi(n,d)  =  0  . 

n-H» 


Proof: 


Proposition  2.3.2: 


lim  P_(n,d)  ■  0  and  lim  P  (n,d)  ■  0 

D  D 

n-H»  n-*30 


Proof : 

Since  P  (n,d) 

D 


the  result  easily  follows 


i 


* 


i 

i 

1 

4 

1 

i 

% 

i 

1 

4 

* 
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3.  FINAL  REMARKS 

Sine*  our  main  objective  in  this  paper  was  to  present  the  distribution* 
Independence  nature  of  our  method  of  generating  randomly  linear  programs 
ve  left  some  uncovered  related  topics. 

(1)  Ve  assumed  a  standard  fora  of  linear  program*  Obviously, 

It  Is  desirable  to  have  the  results  fora  free* 

(2)  Generating  a  linear  program  actually  resulted  In  another 
uniquely  defined  second  linear  program,  namely  the  dual* 

Is  the  (probabilistic)  behavior  of  these  dual  programs 
Identical  with  the  results  obtained  for  the  prlmals? 

(3)  What  would  happen  If  the  continuity  assumption  of  the 
density  function  of  the  coefficients  was  dropped? 

Specifically,  what  If  (as  It  is  believed  to  the  "real" 
case)  there  Is  a  positive  probability  for  a  zero  value? 

(4)  What  can  be  said  about  the  variance  of  the  random 
variables  for  which  expected  values  were  calculated  In 
Section  2? 

(5)  How  the  results  could  be  extented  to  other  characteristics 
of  linear  programs,  specifically,  those  which  are  related 
to  the  efficiency  of  the  Simplex  method?  (such  as  the 
expected  diameter  of  the  feasibility  set,  expected  number 
of  iterations  of  some  variants  of  the  Simplex  method, 
etc. ) . 

In  a  subsequent  paper,  ve  shall  provide  the  answer  to  the  first  three 
questions  and  will  show  that  our  results  are  valid  to  any  form  of  linear 
programs  and  for  the  dual  as  well. 
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Calculating  the  variances  of  the  number  of  different  faces  seems  to 
be  a  much  more  difficult  task,  though  we  believe  they  are  finite  and  in 
the  same  order  of  magnitude  as  the  expected  values.  As  for  the  last 
(and  most  important)  question,  ve  started  some  preliminary  research 
and  hope  to  report  it  in  some  future  time. 
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